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taught (elementary, junior, or senior high); sex of teacher; and 
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experimental treatments were used, varying the personalization used 
m mailing the questionnaire. The six-page instrument concerned the 
use of achievement tests in the classroom. Two follow-ups were sent. 
The overall response rate was an acceptable 80 per cent. A log linear 
model was used to analyze the effects of five variables on survey 
returns: personalized salutation, original signature, grade level 
taught, sex, and population of the school's location. The response 
rate was significantly higher from rural areas and small towns than 
from larger towns. The personalization aspects did not significantly 
affect response rates, but an interactive effect was suggested. There 
were no significant effects of sex or of grade level taught. However, 
there were differential responses to the first, second, and third 
mailings by geographic locale, sex, and giade level taught. General 
conclusions regarding irespondent characteristics would be potentially 
dangerous, without considering the number of follow-ups as a factor. 
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ABSTRACT 



Two aspects of persona fon of cover letters and envelopes were varied to 
test the effects on responses to a mall survey of public school teachers. In 
addition, the effects of sex of teacher « grade level taught* and population of 
the area were evaluated. Questionnaires and two fol1ow*ups were mailed to a 
random sample of 750 teachers. Significant effects were found for vicinity 
population but not for personalization* sex* or grade level taught. 
Significantly higher response rates were obtained ft)m rural areas in comparison 
to more- urcan areas. Differential responses to the first, second* and third 
mallinr *^y sex* level taught* and area population were also found. 
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The Effects of Aspects of Persona 11 zati on « Sext Locale« and Level Taught on 
Educator's Responses to a Hall Survey 

Hall quest tonnaf res have been and continue to be a widely used data 
collection method In educational research. In large part due to their relative 
convenience and to the relatively lower expense Involved. But, Information 
obtained via questionnaire Is not useful unless an acceptable response rate Is 
obtained. Factors affecting response rates to mall questionnaires have been 
reviewed by several authors (e.g., Goyder, 1982; Heber ein & Baumgartner* 1978) 
and Include variables such as sample characteristics* questionnaire 
characteristics, sponsorship, and personalization. The present study examined 
response rates from a sample of public school teachers when aspects of 
personalization were varied. Response rates were also examined for the sample 
characteristics of grade level taught, sex, and location of school (rural vs. 
urban) • 

Personalization procedures refer to design aspects such as original typing of 
envelope addresses, personal cover letter salutations, and hap'j-slgned cover 
letters. Some research has foi'nd personalization to have a modest effect on 
increasing response rates (e.g.. Carpenter, 1975; Hoore, 1941; Slocum et al., 
1956; Yu & Cooper, 1983) while other studies found no effects of personalization 
(e.g., Chllders, Pride, ft Ferrell, 1980; Heberlein & Baumgartner, 1978; LaBreque, 
197fa; Roberts et al., J978). Typed letters brought a higher response rate than 
mimeographed letters (Simon, 1967); hand-signed cover letters had no effect 
according to several researchers (Kawash & Atemoni, 1971; Wellbacher & Walsh, 
1952) and a significant positive effect according to another (Linskey, I%5). 
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DHIman, DHIman and Hakela (1984) strongly advocate the use of personalization 
procedures as part of thoir total design method for mall surveys, suggesting that 
personalization will cither Increase response rates or Interact with other 
variables that will. In contrast, Ruckcr ct al. (1984) found support for the 
hypothesis that repeated use of personalized mailings may have a negative effect 
on response rate. 

The effects of area population on response rates have also been 
Inconsistent. DHIman et aK(1984) and Sudman and Bradburn (19(i4) reporter* 
higher response rates for people In rural than In urban areas, though results 
varied by state. Response rates were found to be higher for rural areas In 
Wyoming In particular (Dlllmpn et al.. 1984). Olllman et at. (1974), however, 
found response rates to vary between rural and urban areas but that the 
differences were not consistent across states. And, In a study of educators, 
Altschuld and Lower (1984) found e higher Initial return rate from larger than 
from small ^ir schools. 

Sex and grade level taught have not been as extensively researched and 
reported as have other sanH>1e characteristics. However, Goyder's (1982) review 
suggests that males return surveys more frequently than females. Altschuld and 
Lower (1984) found no differences In return rates for elementary vs. secondary 
schools. 

Consistent with the general results of previous researchr the following 
research hypotheses were tested In this study: 
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HI: Personalized mailings provide a significantly higher response 
rate. 

(a) Personalization of the cover letter has a significant effect. 

(b) Personalization of the envelope has a significant effect* 

(c) The Interactive effect Is significant, 

H2: Response rates are significantly higher from teachers In rural 
than In urban areas. 

H3: Response rates for males are significantly higher than for 
females. 

H4: Response rate varies significantly with grade level taught. 



HETHOOS 

Subjects 

A systematic random sample was chosen from the State Department of 
Education list of educators «n the State of Wyoming. A total of 750 
teachers' names were drawn. The sample was composed of elementary (481), 
Junior high (24%), and senior high teachers (28%). They were located In 
rural areas (22% in areas of less than 1,000 population), small towns (5Z% 
In towns from 1,000-9,999), and larger towns (27% In towns of more than 
10,300). Of the sample, 641 were female and 36% were male. 

Procedur -^^ 

Two experimental treatments were employed, with subjects randomly 
assigned to each. First, salutations on the cover letter were varied with 
ooe form being •*Oear Educator" typed and xeroxed (50%). The more 
personalized form had the addressee's surname written In by hand (50t). 
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Second, the letter was either signed by hand In blue Ink (51%) or had a 
xeroxed signature (49%). 

A three-page (double-sided) survey Instrument asking about the use of 
achleveinent tests In classrooms was sent to all those In the sanple with a 
cover letter and a stamped (metered) return envelope* Two weeks later* a 
follow-up letter was ^ent; two weeks after this, a second survey form, 
return envelope, and cover letter were mailed. Return rates were as 
follows: first mailing— 51%, first fol low-up~13%, second fol low-uj— 10%. 
An additional 8% of returns Indicated the survey form to be Inappropriate 
(e.g., school llbr^irlan, resource room supervisor), or undellverable as 
addressed. 

Data were analyzed using a log- It near model to assess the effects of 
five variables on survey returns. The variables were salutation, 
signature, level taught, sex, and population of the place where the school 
was located. A true experimental (2x2x3x2x3 factorial) design was used, 
with the first two variables representing the treatments. Subsidiary 
analyses were performed using simple 2-way tables with X values. 

RESULTS 

A significant effect (x^ * 9.31, p<.01) on final survey return rates 
was found for locale with a higher response rate from areas with lower 
populations. There were no significant effects of experimental variables 
or of sex or grade level taught. The Interaction effect of salutation and 
signature approached significance (x^ * 3.04, p<.08). (See Tables 1 and 
2.) 

(Tables 1 and 2 here) 
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There were also significant differences in responses to the first, 

2 

second, and third dtai lings by locale (x » 12.74, p<.02) and by sex 
2 

( X * 6.04, p<.05). Response rate to the initial mailing was higher 
for towns than for rural areas. Responses to the first follow-up were 
greater for larger towns than for rural areas or smaller towns, and, 
finally, responses to the second follow-up were greater for the rural 
areas (Table 3). Hales responded to the initial mailing at a higher rate 
than females, with females responding to the first follow-up at a higher 
rate (Table 3). 

(Table 3 about here) 



DISCUSSION 



The overall response rate (80%) of teachers to the survey administered 
was within acceptable limits. Consistent with previous research, the 
response rate was higner from rural areas and smaller towns than from 
Iprger towns. The aspects of personalization which were varied had no 
significant effect on response rates, though there was some indication of 
interactive effects. Fewer surveys were returned if there was an 
incongruency in salutation and signature; that is, if one were 
personalized and the other not. But, this interaction was not significant 
at p<.05. If replicated in other work, however, this result would suggest 
that personalization either be used In full — personalized salutation, 
signature, and possibly envelope address, and postage stamp — or not be 
used at all. This suggestion would be consistent with the Olllman et a1. 
(1984) total design method. Response rates In this study were essentially 
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equivalent for perscx^l izatlon and no personal I rat ton. Only two aspects 
of personalization were varied* though. A larger scale study could vary 
four or five aspects of personalization while still maintaining sufficient 
power to detect differences. Clear ty» personalization of surveys couts 
both money and time. If no substantial Improvement In response rate Is 
seent then this time and money perhaps may better be spent In other 
actlvttteSf such as cor^tlnutng to follow-up nonrespondents. 

Locale and sex differences in response rates to first* second* and 
third mailings Indicate the potential dangers of drawing general 
conclusions regarding respondent characteristics without considering the 
number of follow-ups as a factor. 

Results of this study are limited by the factors considered and the 
sample size. The population was restricted to public school teachers 
only. Different results might be obtained if other populations in other 
areas were to be sampled. 
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Table 1. Response vs. no response by Locale 



Rural 



Locale 

Small Town 



Larger Town 



Re^sponse 
Count 

Row percent 
Column percent 



117 

21.5 

81.3 



297 

54.5 

83.0 



131 

24.0 

72.8 



No response 
Count 

Row percent 
Column percent 



27 
19.7 
18.8 



61 
44.5 
17.0 



49 
35.8 
27.2 



Table 2. Response vs. nc response by salutation and signature 



Salutation: 


Hand signed 
Xeroxed Personal 


Signature 
Xeroxed 


Xeroxed 
Personal 


Response 










Count 


135 


130 


138 


146 


Percent of 


19.7 


18.9 


20.1 


21.3 


total 










Nonresponse 










Count 


41 


26 


28 


42 


Percent of 


6.1 


3.7 


4.1 


6.1 



total 



Table 3. Returns by mailing, locale, and sex 



Rural 



Locale 
Small Town 



Larger Town 



Sex 

Male Female 



Initial mailing 

Count 69 

Row Torcent 18.4 

Column percent 59.0 

First follow-up 

Count 23 
Row percent 23.2 
Column percent 19.7 

Second follow-up 
Count 25 
Row percent 34.7 
Column percent 21.4 



214 

57.2 

72.1 



47 
47.5 
15.8 



36 
50.0 
12.1 



91 
24.3 
69.5 



29 
29.3 
22.1 



11 
15.3 

8.^ 



192 

39.2 

74.0 



24 
25.5 
12.5 



26 
36.6 
13.5 



220 

60.8 

65.7 



70 
74.5 
20.9 



45 
63.4 
13.5 
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